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Abstract 

Gauss' law of error is generalized in Tsallis statistics such as multifractal systems, in which Tsallis 
entropy plays an essential role instead of Shannon entropy. For the generalization, we apply the 



' new multiplication operation determined by the q— logarithm and the g— exponential functions to 

O ' the definition of the likelihood function in Gauss' law of error. The maximum likelihood principle 
leads us to finding Tsallis distribution as nonextensively generalization of Gaussian distribution. 
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I. INTRODUCTION 



The maximum entropy principle for Tsallis entropy 



m 



under the constraints: 



S, := (q € K+) (1) 



yields the so-called Tsallis distribution: 

where exp^ (x) is the q— exponential function defined by 

exp,W:Jl^ + <^-'''^l'^'" + '^-''^>»- (xeR) (4) 
I otherwise 

and f3q is a positive constant related to a and P^]. For q ^ 1, Tsallis distribution Q 
recovers a Gaussian distribution. The power form in Tsallis distribution (jS)) has been found 
to be fairly fitted to many physical systems which cannot be systematically studied in the 
usual Boltzmann-Gibbs statistical mechanics j5|. 

The mathematical basis for Tsallis statistics comes from the deformed expressions for the 
logarithm and the exponential functions which are the q— logarithm function: 

ln„ X := (x>0,qe M+) (5) 

1 — q 

and its inverse function, the q— exponential function Q. Using the logarithm function 
(0), Tsallis entropy (0) can be written as 

S, = -J fixf\nqf{x)dx, (6) 

which is easily found to recover Shannon entropy when q —>■ 1. 

The successful many applications of Tsallis statistics stimulate us to try to find the new 
mathematical structure behind Tsallis statistics 6]. Some physicists reported some relations 
to the g— analysis which has been usually discussed in quantum group 
relations to the g— analysis, Borges presents a deformed algebra related to the o— logarithm 
and the g— exponential function which naturally emerge from Tsallis entropy |[9|. 



. Apart from the 



Using the algebra introduced by Borges, we derive Tsallis distribution by applying the 
multiplication operation determined by the g— logarithm and the exponential function 
to the maximum likelihood principle (MLP for short). Concretely, the new multiplication 
operation which is called the q— product in jol, is applied to the likelihood function in 
Gauss' law of error with the result that we obtain Tsallis distribution as nonextensively 
generalization of Gaussian distribution. The present derivation of Tsallis distribution is 
another way than the above maximum entropy principle (MEP for short, in contrast to 
MLP). 



II. GAUSS' LAW OF ERROR 



In order to clarify our ideas in the present work in section IV, we briefly review Gauss' 
law of error in this section. 

Consider the following situation: we get n observed values: 

xi,X2, • • ■ e M (7) 

as results of mutually independent n measurements for some observation. Each observed 
value (i = 1, ■ ■ ■ , n) is each value of independent, identically distributed (i.i.d. for short) 
random variable (i = 1, ■ ■ ■ , n), respectively. There exist a true value x satisfying the 
additive relation: 

= a; + Cj (i = 1, ■ ■ ■ , n) , (8) 

where each of Cj is an error in each observation of a true value x. Thus, for each Xj, there 
exists a random variable Ei such that Xi = x + Ei {i = 1, ■ ■ ■ ,n). Every Ei has the same 
probability density function / which is differentiable, because Xi,--- ,Xn are i.i.d. (i.e., 
El, ■ ■ ■ , En are i.i.d.). Let L {9) be a function of a variable 9, defined by 

L{9) = L{xuX2, - ■ ■ ,Xn,9) := f {xi - 9) f {X2 - 9) ■ ■ ■ f (x„ - 9) . (9) 

Theorem 1 // the function L {xi, X2, ■ ■ ■ ,Xn;9) of 9 for any fixed xi,X2, - ■ ■ ,Xn takes the 
maximum at 

9 = 9*:= ^^ + ^^ + --- + ^", (10) 

n 

then the probability density function f must be a Gaussian probability density function: 

1 ^ r ^ 



/(e) = ^exp|-;^^. (11) 
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The above result goes by the name of Gauss' law of error" [ICf] which is often used as 
an assumption in measurements in many scientific fields. In fact, on the basis of Gauss' 
law of error some functions such as error function are often used to estimate error rate in 
measurements. 

Note that the assumption (jSI) means each error Cj is additive to the true value x. This 
assumption essentially contributes the determination of a Gaussian probability density func- 
tion as seen in the proof below. The last assumption is a representation of MLP. In MLP, the 
parameter 9 and the function L (9) are called population parameter and likelihood function, 
respectively. The statement of the last assumption is rewritten in MLP as follows: for the 
likelihood function L (9) given by 0, the maximum likelihood estimator is 

e := A-.+A-. + ... + X„^ 
n 

Here we present the rigorous proof of Gauss ' law of error. 
Proof. Taking the logarithm of the both side of the likelihood function L (6) in Q leads to 

lnL(6') = ln/(xi-^)+ln/(x2-^) + --- + ln/(x„-^). (13) 

Differentiating the above formula ()13|) with respect to 6, we have 

Lf{9) ^ ff{x,-9) _ _ ffjxn-e) 

L{9) f{x,-e) f{xn-9)- ^ ^ 

The last assumption implies that when 9 = 9* the likelihood function L [9) takes the maxi- 
mum value, so that 

^""7 = (15) 



I.e., 



L 



fi{xi-9*) fiixn-9*) ^ 



Let e* be defined by 
then can be rewritten to 



f{x^-9*) fix^-9*) 

e*:=x,-9* (2 = 1, ■■■,«), (17) 



Using the new function (j) (e) defined by 



(18) 



()18|) becomes 

n 

^0(en = O. (20) 
On the other hand, summing up the both sides of p7|) for alH = 1, ■ ■ ■ , n, we obtain 

n n 

^e: = 5^x,-nr = 0, (21) 

i=l 1=1 

where we used firUjl . 

Then our problem can be reduced to finding the function satisfying (j2Up under the 
constraint (j2H) . For simphcity, "*" in e* is abbreviated in the rest of this proof. 
From ^IT^ we obtain 

f ^-1 (Ml). (22) 

SO that differentiating with respect to Ci goes to 

#h)_^ = (.^1). (23) 

dei dci 

The choice of ei does not lose the lack of generality in the above two formulas fl22|) and ()23p. 
so in general there exists a constant a G M such that 

^ = a. (24) 
ae 

Thus, it implies 

(e) = ae + 6 (25) 
for some 6 G M. Applying this formula and (PT|) to ((201), "^^ get 

ra n 

= ^0 {a) = a^ei + nb = nb, (26) 

i=l i=l 

SO it implies 

b = 0. (27) 

Therefore, 

(e) =ae ^ = ae. (28) 

The solution / satisfying ()28|1 can be obtained to 

/(e) = Cexp[^] (29) 
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where C is a constant. / is an even function and a probabihty density function, so that 
a < 0. Thus, there exists a constant h > such that a can be set to 

I = -h'- (30) 

Then, / becomes 

/(e) = Aexp(-/.V) (31) 



where / / (e) rfe = 1 is used, h can defined by 

/.:^-i->0, (32) 
therefore we can determine / as a Gaussian probabihty density function with mean zero and 



variance a^: 



/w=^-p{-^r (33) 



Note that Gauss' law of error tells us that in measurements it is the most probable to 
assume a Gaussian probability distribution for additive noise, which is often applied to every 
scientific fields. 

In section IV, Gauss' law of error is generalized to the nonextensive systems, which results 
in Tsallis distribution as a generalization of Gaussian distribution. 

III. THE NEW MULTIPLICATION OPERATION DETERMINED BY 
g-LOGARITHM FUNCTION AND g-EXPONENTIAL FUNCTION 

The new multiphcation operation is first introduced by Borges in for satisfying the 
following equations: 

lug {x (g)g y) = lnqX + luq y, (34) 

expg (x) (g)g expg (y) = exp^ {x + y) . (35) 

These lead us to the definition of between two positive numbers 

[x^-'^ + y^-'i - 1]^ , if X > 0, y > 0, x^-'^ + y^-'i - 1 > 
x®qy:={ , (36) 

0, otherwise 
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which is called q— product in The q— product recovers the usual product such that 
lim {x (8>g y) = xy. The fundamental properties of the g— product are almost the same as 
the usual product, but the distributive law does not hold in general. 

a {x y) ^ ax ®qy (a, x, ?y G M) (37) 

The properties of the q— product can be found in j^. For the purpose of this paper, the 
differentiation of the g— logarithm function is also needed in the next section. 

— ln„ X = — (38) 

ax x^ 

IV. NONEXTENSIVELY GENERALIZATION OF GAUSS' LAW OF ERROR 

This section presents the law of error in Tsallis statistics with the rigorous proof along 
the same line as that of Gauss' law of error. 

Consider the same setting as n observed values, as Gauss' law of error: we get n observed 
values: 

Xi,a:2, ■ ■ ■ G M (39) 

as results of n measurements for some observation. Each observed value Xj (z = 1, ■ ■ ■ , n) is 
each value of identically distributed random variable Xj (? = 1, ■ ■ ■ , n), respectively. There 
exist a true value x satisfying the additive relation: 

Xi = X + Ci (i = 1, ■ ■ ■ , n) , (40) 

where each of is an error in each observation of a true value x. Thus, for each Xj, there 
exists a random variable Ei such that Xi = x + Ei {i = 1, ■ ■ ■ ,n). Every Ei has the same 
probability density function / which is differentiable, because Xi,--- ,X„ are i.i.d. (i.e.. 
El, - ■ ■ , En are i.i.d.). Let Lg (9) be a function of a variable 9, defined by 

Lg (9) = Lg (xi, X2, ■ ■ ■ , x„; 6*) := / (xi - 9) (g)g f (x2 - 9) ®g ■ ■ ■ ®g f {x^ - 9) . (41) 

Theorem 2 // the function Lg (xi, X2, ■ • • , x„; 9) of 9 for any fixed xi, X2, ■ ■ ■ , x„ takes the 
maximum at 

9 = 9* ^^ ^i + ^2 + --- + x. ^ 
n 
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then the probability density function f must be a Tsallis distribution: 



^ / expg {-f^qe^) de ^^^^ 
where (3q is a q— dependent positive constant. 

Proof. Taking the g— logarithm of the both side of the hkehhood function Lg (6) in (pT|l 
leads to 

In, Lg (9) = In, / {xi - 9) + \nq f {x2 - 9) + ■ ■ ■ + In, / (x„ - 9) (44) 

where the property (jH^ is used. Differentiating the above formula with respect to 9 
according to (jHHj) . we have 



When 9 = 9* the likelihood function L, {9) takes the maximum, so that 



(45) 



Lj(9*) fiixi-9*) fiixn-9*) , , 



{Lq{9*)f (/(x„-^*)) 
Let e* and (e) be defined by 

e::=a;,-r (2 = l,---,n), 0,(e):=^|^, (47) 

then ()46j) can be rewritten to 

n 

J]0,(e*)=O. (48) 

On the other hand, summing up the both sides of the former formula in (|47p for all i = 
1, ■ ■ ■ , n, we obtain 

n n 

J2e* = J2x,-n9* = 0, (49) 

i=l i=l 

where we used 



Then our problem can be reduced to finding the function 0, satisfying ()48p under the 
constraint (jl^ . For simplicity, "*" in e* is abbreviated in the rest of this proof. 
From ()49j) we obtain 

(./I), (50) 
SO that differentiating pH|l with respect to ei goes to 

^%i^-^%M = o (.^1). (51) 

aei acj 



The choice of ei does not lose the lack of generality in the above two formulas fjSOp and ()5ip 
so in general there exists a g— dependent constant G M such that 

d(f}g (e) 



de 



e) = a„e + bg 



for some bq G M. Applying this formula and to (PH| . we get 



Cj + nbg = nbq =^ bg = 0. 



1=1 



Therefore, 



bg [e) = age <^ 



Pie) 
(/(e)) 



q (IqC 



Using the property (j38|l . (j5l|l can be integrated with respect to e: 



In, / (e) 



where C„ is a g— dependent constant. Thus we obtain 



/(e 



l + (l-9) 



(52) 



(53) 



(54) 



(55) 



(56) 



When 1 + {1 — q) { + C*, ) > and 1 + (1 — g) > 0, / (e) can be rewritten as follows: 



/(e) 



i + (i-g)R^ + a 



[l + {l-q)Cq]^- 



l + (l-9) 
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(57) 
(58) 



2(l + (l-g)C,) 

expg (C,) expg (-/3,e2) cx exp^ (-/J.e^) = [l + (1 - g) (-/^^e^)] ^ (59) 



where 



2(l + (l-g)C,)- 
Thus, the normalization condition j f {e) de = 1 implies that 

6xp„ (Cg) = -J. - - :^r-r- 
J expg (-/JqC^) de 

Moreover, since Lg (9) takes the maximum at ^ = ^ ''^gi"'^^^ 

aMn^Lj^) _ 2n (-/?,) 



> 



(60) 
(61) 

can be computed as 
(62) 



=0. {Jexpg{-pge^)deY 
so that /5g > 0. Therefore, we can determine (jlHjl for the probability density function /. ■ 
Our result / (e) in PHj) coincides with Q by applying the g— product to MLP instead of 
MEP. 
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V. CONCLUSION 



We obtain law of error in Tsallis statistics by applying the g— product to MLP. The 
g— product is defined as the new multiplication operation derived from the g— logarithm 
and (/—exponential function. These functions, g— logarithm and g— exponential functions, 
naturally emerge from Tsallis entropy. Our present result reveals that in Tsallis statistics 
the g— product can constitute some important probabilistic formulations. The model for 
Tsallis distribution has been presented in Moreover, based on our result, the error 

functions in Tsallis statistics can be also formulated as similarly as those of Gauss' law of 
error. 



[1] C. Tsallis, Possible generalization of Boltzmann-Gibbs statistics, J. Stat. Phys. 52, 479-487 
(1988). 

[2] E.M.F. Curado and C. Tsallis, Generalized statistical mechanics: connection with thermody- 
namics, J. Phys. A 24, L69-L72 (1991); Corrigenda 24, 3187 (1991); 25, 1019 (1992). 

[3] C. Tsallis, S.V.F. Levy, A.M.C. Souza and R. Maynard, Statistical-mechanical foundation of 
the ubiquity of Levy distributions in nature, Phys. Rev. Lett. 75, 3589-3593 (1995) [Erratum: 
77, 5442 (1996)]. 

[4] D. Prato and C. Tsallis, Nonextensive foundation of Levy distributions, Phys. Rev. E 60, 
2398-2401 (2000). 

[5] C. Tsallis et al., Nonextensive Statistical Mechanics and Its Applications, edited by S. Abe and 
Y. Okamoto (Springer- Verlag, Heidelberg, 2001); see also the comprehensive list of references 
http:/ /tsallis . cat . cbpf . br /biblio . htm 



at 



[6] H. Suyari, Nonextensive entropies derived from form invariance of pseudoadditivity, Phys. 
Rev. E 65, 066118 (7pages) (2002); H. Suyari, On the most concise set of axioms and the 
uniqueness theorem for Tsallis entropy, J. Phys. A., 35, 10731-10738 (2002); H. Suyari, The 
uniqueness theorem for the nonextensive entropy, Proc. 2003 IEEE Int. Symp. Inform. Theory, 
260 (2003). 

[7] S. Abe, A note on the g— deformation theoretic aspect of the generalized entropies in nonex- 
tensive physics, Phys. Lett. A 224, 326-330 (1997); S. Abe, Nonextensive statistical mechanics 



10 



of g— bosons based on the (7— deformed entropy, Phys. Lett. A 244, 229-236 (1998). 
[8] R.S. Johal, g— calculus and entropy in nonextensive statistical physics, Phys. Rev. E 58, 4147- 
4151 (1998). 

[9] E.P. Borges, A possible deformed algebra and calculus inspired in nonextensive thermostatis- 

tics, |cond-mat/0304545| 
[10] A. Hald, A history of mathematical statistics from 1750 to 1930, New York, Wiley (1998). 
[11] J.A.Cordeiro, M.V. B.T.Lima, R.M. Dias and F.A. Oliveira, Morphology of growth by random 

walk deposition, Physica A 295, 209-214 (2001). 



11 



